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FOREWORD 


These Clinical Outcome Indicators were produced by a Working Group of 
the Clinical Resource and Audit Group chaired by Dr Dorothy Moir, 
Director of Public Health for Lanarkshire Health Board. They are 
derived from information collected routinely by the Registrar General 
and the Information and Statistics Division of the Common_ Services 
Agency and ISD staff played a key role in assisting the Working Group. 
The 7 Indicators in Group A compare the populations of the 15 Health 
Boards; the 7 Indicators in Group B compare the average outcomes of 
patients treated by over 20 NHS Trusts and Directly Managed _ Units, 
most of them general hospitals; and the 3 Indicators in Group C 
compare average mortality rates after discharge from 29 psychiatric 
hospitals and units. 


How each Health Board compares with its neighbours and how each Trust 
compares’ with its competitors will attract considerable interest, not 
least from the Boards and Trusts themselves. That is indeed why these 
Clinical Outcome Indicators are being published in this format. It is 
essential, though, that everyone - particularly people who have 
recently been, or may soon be, treated in one of the _ hospitals 
involved - should understand the limitations of these comparisons. 
They do not constitute "league tables" and are not comparable to the 
information in the recently published "Patients’ Charter : Raising the 
Standards in Scotland”. Comparisons of waiting times for 
Outpatient appointments or for admission to hospital, or cancellation 
rates for planned admissions, provide both patients and _ general 
practitioners with valuable information about the relative 
performance, and relative attractions, of different hospitals. 


These 17 Clinical Outcome Indicators do not provide comparable 
information, either about the efficacy of the treatment provided for 
particular conditions in different hospitals. or about the 
effectiveness of the services provided for the inhabitants of the 
different Health Boards by the NHS as a whole. This is because 
differences in clinical outcome - in mortality after a heart attack or 
a stroke, for example - are just as likely to be due to differences in 
the patients themselves as they are to be due to differences in the 
quality and efficacy of the treatment they received. Even though 
differences in age and sex have been allowed for, the _ patients 
attending different hospitals may differ considerably in a variety of 
other ways which affect how well they respond to. treatment, 
particularly if they are drawn from neighbourhoods with very different 
social and economic characteristics. Patients may differ, for 
example, in the length of time they have been ill before consulting 
their general practitioner or being referred for treatment, or in the 
extent to which they have other complicating conditions like diabetes 
or high blood pressure. There may also be unrecognised differences in 
the diagnostic criteria used by the staff of different hospitals, or 
in the extent to which they treat patients with comparatively mild 
conditions. Mild illnesses always tend to have a better outcome than 
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For all these reasons, it would be wrong to conclude from any of these 
Clinical Outcome Indicators that one _ hospital provides better 
treatment than another, or that one Health Board’s patients receive 
better care than those of its neighbours, or even that they did so in 
the period to which the indicators relate (mainly 1990-93). If one 
really wished to find out which of two hospitals provided better 
treatment for a particular condition it would be necessary to carry 
out a "controlled clinical trial". This would involve allocating 
patients randomly to each hospital in turn to ensure that the two were 
treating comparable populations, and in most circumstances this would 
be both impracticable and unethical. 


These comparisons of the positions of different Health Boards and NHS 
Trusts on these 17 Clinical Outcome Indicators are being disseminated 
throughout the NHS in Scotland, not to enable general practitioners or 
the general public to decide which localities and hospitals provide 
the most expert care but to help raise overall standards of care. If 
an individual NHS Trust appears to fare badly on a_ particular 
indicator we expect that the clinicians concerned’ will immediately 
review their treatment of that condition to find out whether it is 
unusual or incomplete in any way, and why others appear to be getting 
more’ satisfactory results. We also expect that the Health Boards and 
Fundholding GPs purchasing treatment from that Trust will have 
questions to ask, and that those questions will often lead to an 
agreement between purchaser and provider that a clinical audit focused 
on the condition in question should be carried out to try to identify 
the likely cause of the disparity. If there appear to be substantial 
differences in outcome for the treatment of a_ particular condition 
which involve several hospitals we also expect the clinicians 
concerned to discuss the issue amongst themselves, and perhaps to 
mount a  Scotland-wide audit. Indeed this is already happening in a 
number of areas. 


In time these Clinical Outcome Indicators will be updated by CRAG and 
republished. Other indicators may also be added to the portfolio. In 
the meantime, | and the members of Dr Moir’s Working Group trust that 
the information in this volume will provide food for thought, and for 
action, for both the purchasers and the providers of healthcare. It 
should not, though, be used either by the general public or by general 
practitioners as a basis for inappropriate and premature conclusions 
about which Health Boards and hospitals provide the best healthcare. 


Label Kael 


R E KENDELL 
Chairman, Clinical Resource and Audit Group 
December 1994 
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INTRODUCTION 


si, 


9 Ryd 


In December 1992 the Clinical Outcomes Working Group 
recommended action’ in relation to reporting the quality of 
care and clinical outcomes. This was drawn to the attention 
of the service in MEL(1992)87 for inclusion in service 
contracts for 1993-94. The action required related to three 
main areas of activity: 


(i) the quality and completeness of the Clinical 
information supplied to ISD which forms the basis _ of 
the current reporting; 


(ii) specific outcome measures in selected clinical areas; 
and 


(iii) action in relation to new clinical data collections 
associated with national clinical audit systems and 
national guidelines for clinical practice. 


Interest has tended to centre on specific outcome measures 
but all three areas of activity are equally important to 
continued development in this area. The Working Group's 
Original report of December 1992 fully described the 
background to this work. It remains relevant to discussion 
and to further development and is reproduced at Annex 3. It 
has been agreed, however, that use of the term "outcome 
indicators". is more appropriate than "outcome measures" and 
this new term will be used in the current report. 


SPECIFIC CLINICAL OUTCOME INDICATORS 


an 


This report describes work that has taken place over the last 
12 months in each of the three areas of activity. It gives 
updated results, at individual hospital level, for the five 
Clinical outcome indicators reported in the June 1993 Report 
(MEL(1993)93) at health board level. It also extends the 
range of indicators to include stroke and mental health and 
indicators of population health status reported at health 
board level. The relevant tables and graphs for health 
boards and hospitals in Scotiand providing services § are 
presented in the technical annex to this report. These are 
accompanied by general notes onthe derivation of each 
indicator including the period of coverage, standardisation, 
confidence intervals and data sources. Each _ specific 
indicator is accompanied by exact definitions of the period 
covered, case selection and outcome event in question. 


Bie 


2.3 


2.4 


Each individual indicator is also accompanied by a discussion 
of technical issues relevant to the interpretation of the 
data. Variations may arise from the relative quality and 
completeness of the data supplied for the Scottish Morbidity 
Record (SMR), local case mix, geographic variations in 
disease and other factors. The commentary is based on 
continued investigation of the data. 


Mortality after acute myocardial infarction is the measure 
that has been most fully investigated so far. Discussions 
have been held with clinical staff, and doctors in_ public 
health medicine in the Scottish Office Home and _ Health 
Department and_ in the University of Edinburgh have carried 
the work forward. This work has been submitted for 
publication. This is the sort of discussion that the Working 
Group is seeking to promote for each indicator identified, in 
order to gain the fullest understanding of the use of such 
indicators and secure agreement from all interested parties 
about their robustness and validity, and their relevance to 
improving the quality of care for patients. 


It is emphasised that no direct inferences can be made on the 
basis of the information provided about the quality of care 
in different health boards or hospitals. The aim is_ to 
concentrate discussion on the possible reasons for variations 
in order to promote the investigation of the underlying 
Causes and to secure improved quality of reporting in future, 
thereby to contribute to raising the standards of health care 
across Scotland. 


QUALITY OF CLINICAL INFORMATION 


3. 


The indicators reported, at present, at hospital level are 
all based on SMR data held centrally by ISD and. on deaths 
data from the Registrar General. The first of the Working 
Group’s_ original recommendations in 1992 to be included in 
contracts for 1993-94 was that a structured review should be 
carried out of the quality of the clinical information 
provided to ISD. _ The target was set at 90% accuracy and 
completeness of coding to be achieved by the end of the first 
year. Discussions have shown that in many areas that audit 
of data quality. may not yet have been completed. Health 
Boards are being asked, through their Directors of Public 
Health, to review the position and to request the results of 
this audit in the hospitals in their area, and to report back 
to the CRAG Secretariat and ISD on the results of this review 
and any associated action taken or proposed. The need for 
any further central initiatives will then be considered. To 


ee 


assist in this process, the joint CRAG-ISD report "Precise 
Clinical Summaries: the source of high quality SMR _ data’, 
first published in 1990, and which will remain relevant until 
1996, is available from the CRAG Secretariat. Hospitals may 
seek assistance in this exercise from the Quality Assurance 
Branch of ISD. 


CLINICAL AUDIT DATABASES AND RELATED ACTIVITY 


4. 


The third element of the original recommendations concerned 
Clinical information databases and other related activity and 
gave notice of CRAG-sponsored developments in this area which 
boards should prepare to adopt. Four of these are now in 
place or about to become available on a national basis, and 
details are set out below. 


Scottish Audit of Surgical Mortality 


4.1 


This audit includes perioperative deaths in all of the main 
surgical sub-specialties with the intention of involving all 
surgeons and all anaesthetists working in those fields. It 
corresponds to the National Confidential Enquiry into 
Perioperative Deaths (NCEPOD) in England and became 
operational on a_ consistent basis across Scotland on 1 
January 1994. The audit is led jointly by the Royal College 
of Surgeons of Edinburgh, the Royal College of Physicians and 
Surgeons of Glasgow and the Royal College of Anaesthetists. 
All contracts for surgical services should now provide the 
necessary local support to enable this audit to proceed. The 
major part of the funding relates to the organisation at 
regional level and is provided at present by CRAG. 
Discussions will be initiated about possible mechanisms for 
transferring these costs to contract funding. 


Scottish Intensive Care Society Audit 


4.2 All intensive therapy units in Scotland have been equipped by 


CRAG with hardware and software to enable systematic clinical 
audit to take place on the basis of the APACHE 3 _ predictive 
scoring system. The major part of the cost of this system is 
borne at present by CRAG but associated local costs should be 
identified in discussion between providers and purchasers and 
appropriately reflected in contracts. 


Scottish Trauma Audit 


4.3. In Accident and Emergency Medicine the system developed in 
four hospitals on a pilot basis by the Scottish Trauma Audit 
Group, in collaboration with the international Major Trauma 
Outcomes Study, is being considered for release to A&E 
Departments which regularly treat major trauma patients. The 
first phase of this work was reported at a major conference 
in November 1994 and discussion about extending this audit 
has been initiated. 


ENT Services 


4.4 Tonsillectomy was the subject of the first Scottish national 
clinical audit in otolaryngology. The results of this audit 
will assist in the definition of the core data to be 
collected by all ENT units. 


THE 1994 REPORT 


5. Although Scotland is making good progress in the development 
and use of outcome indicators largely because of the clinical 
information that is available through the national data sets 
and data _ linkage, the work is still at a very early stage. 
The quality and completeness of recording of the _ clinical 
information on which the indicators are based requires 
further improvement. Case mix, severity and other variables 
must be taken into account in comparing one hospital's data 
with another. The emphasis at present therefore must be on 
continuing development through detailed local discussions 
between clinicians, medical managers and other _ professional 
staff so that the material can be presented in a form that is 
accepted and can be used with confidence by every interested 


group. For these reasons, a ‘health warning’ has to 
accompany the _ interpretation and use of each Clinical 
indicator. 


THE CONTINUING DEVELOPMENT PROGRAMME 
DEVELOPMENT OF THE CURRENT CLINICAL OUTCOME INDICATORS 


6.1 Directors of Public Health are being asked to __ initiate 
discussions on the development of the current clinical 
Outcome indicators with local clinicians and __ professional 
bodies (for example, Area Clinical Audit Committees, Area 
Medical Committees and other professional advisory 


An 


6.2 


6.3 


6.4 


committees). This will provide insight into the nature and 
uses of the existing indicators and may _ enable _ further 
standardisation. 


Health Boards are being asked to report back, through 
Directors of Public Health, on other outcome indicators — in 
use or under consideration locally, for possible wider use. 
Comparative outcome indicators are at their most useful when 
used to identify possible areas of improvement within 
individual departments or hospitals, but the use of outcome 
indicators should also improve the quality of clinical data 
and the quality of clinical and management decisions. 


This report includes for the first time indicators for stroke 
and mental illness as well as_ selected indicators of 
population health status by health board. This extends’ the 
number of specialties and care sectors involved in the 
exercise and_ introduces indicators of the joint impact of 
primary, secondary and community care as well as_ services 
provided by health boards, including health education, 
screening and immunisation programmes. It is intended to use 
this wider coverage to enhance the general debate. 


The degree to which the outcome indicators based upon linkage 
between hospital and death records are up-to-date is limited 
by the frequency of linkage. This is currently annual. 
However, quarterly linkage will be implemented from mid-1995 
allowing more up-to-date outcome indicators to be calculated. 


FUTURE DEVELOPMENT OF CLINICAL OUTCOME INDICATORS 


fan 


(es 


Work is’ in hand to identify clinical outcome indicators 
suitable for a range of different purposes, and to’ set in 
motion the data collection required to support them where 
that is required. Clinical outcome indicators will continue 
to be explored for a wider range of specialties, using SMR 
data and data linkage. The intention is to try, at the same 
time, to select indicators that are clearly relevant to the 
decisions people, including professional staff and patients 
and carers, have to make. 


The current indicators include some based on relevant end 
points other than simple mortality. These include discharge 
home, readmission rates and _ reoperation § rates. This 
principle of relevance’ to the patient’s interest will be 
developed in further work. 


5: 


8 


7.4 


Dd 


Clinical guidelines are, at present, under development by the 
Scottish Intercollegiate Guidelines Network (SIGN) in 
association with CRAG under the criteria agreed by SIGN and 
CRAG based on the 1993 CRAG report "Clinical Guidelines". It 
is intended that guidelines for possible adoption nationally 
should include outcome indicators by which the particular 
episode of treatment should be examined and will specify the 
core data that should be collected to enable these outcomes 
to be reported on a consistent basis. 


The Scottish Needs Assessment Programme (SNAP) has been asked 
to specify in each of its reports the outcome indicators 
necessary to identify whether need is being met. 


Other types of clinical indicators are under review. These 
include: 


process measures and other proxy measures, which can with 
confidence attribute a specific outcome to a_ specific 
intervention, may be acceptable in some conditions as a 
proxy for actual outcome; 


tracer conditions common to an_ identified group of 
providers are being investigated as general indicators of 
quality of care. Definitive work is about to start in 
hospital acquired infection and pressure area care. 
Measures of success in post-operative pain relief or pain 
control in certain chronic conditions may also be 
feasible. These measures will depend on new data 
collections for which definitions and other conventions of 
reporting must be agreed at the outset; 


sentinel events (critical incidents) are rarely occurring 
events all of which should be investigated for the lessons 
they may hold for future clinical and general management. 
Deaths from acute asthma are an example of a current audit 
of this kind, which is relevant in general practice as 
well as_ in hospital. Another example is perioperative 
deaths which are now reviewed individually through the 
Scottish Audit of Surgical Mortality on a consistent basis 
throughout the country. Sentinel events may, however, 
have greater relevance to on-going audit and to improving 
overall performance than to clinical outcomes as such. 


OUTCOMES IN CHRONIC DISEASE AND COMMUNITY CARE 


8.1 


Outcome indicators in chronic disease, geriatric care and 
rehabilitation are __ particularly difficult, because the 
desired outcome may be maintenance of competence for example 


iG. 


8.2 


in the activities of daily living, or prevention of deterior- 
ation. General health status assessment together with 
disease specific outcome assessment may be possible in this 
and other clinical contexts where it has been proved to. be 
valid. | Sequential assessment with the same tool for example 
the Barthel Index is feasible but interpretation of changes 
is problematic. Work is planned with the WHO-sponsored 
European programme to develop outcomes in geriatric care. 
The Scottish component will involve geriatric care with 
occupational therapy in hospital and in the community. 


In chronic disease and community care the attainment of the 
goals set out in the care plan may be a possible outcome 
indicator. The evaluation of goal attainment tends to be 
based on practitioner assessment and remains largely 
subjective. The usefulness of indicators derived in this way 
in a wider context is not yet clear. The Health Systems 
Division is working with healthcare professionals in the 
community services on the further development of a _ core 
community data set which should assist this process (see 
paragraph 10 below). 


ASSOCIATED DEVELOPMENTS 


Gad 


9,2 


Comparisons of outcome indicators on a national basis are 
likely to be reported increasingly from national audit 
systems developed through CRAG. Clinical areas where such 
work is underway include obstetrics and gynaecology, 
otolaryngology, intensive therapy, vascular surgery, 
paediatric heart disease, and the breast and cervical cancer 
screening programmes. 


Clinical guidelines are being developed under the direction 
of SIGN for deep vein thrombosis and palliative radiotherapy 
for some forms of lung cancer. A data set related to 
diabetic patients will be available soon. This is in 
response to MEL(1993)156. A further 12 national guidelines 
are in preparation through SIGN. All national guidelines 
will include a section on clinical audit and outcomes. The 
minimum core data and reporting will be specified and will 
include key indicators of risk and of severity of the disease 
On presentation. Both of these elements are confounding 
factors in all comparative analyses of outcomes and are among 
the most difficult to record and to_ standardise. All 
protocols for local practice which are developed from 
national guidelines will be expected to provide for clinical 
audit of local practice. 


9.3. Predictive scoring systems based on risk assessment are 
already in use. The APACHE 3 system is used in the Scottish 
Intensive Care Society audit; the TRISS system is used in 
the Scottish Trauma Audit Group’s audit of outcomes for major 
trauma; and the CRIB predictive scoring system for low birth 
weight babies has been developed with joint funding from 
research sources and from CRAG. All such systems will have a 
major impact on the ability of clinicians to audit outcomes 
accurately and on a_ consistent basis that will allow 
comparison with standards set in clinical protocols and with 
other practitioners’ performance. They are an_ important 
factor in international collaborative audit. 


NATIONAL DATA SETS - FUTURE DEVELOPMENTS 


10. In the longer term changes in the methods of collecting 
national data sets will open up new opportunities for 
reporting clinical outcomes. These include: 


Core patient profile information in Scottish hospitals 
(COPPISH). This is a reorganisation of the existing data 
sets which will provide space for specialty and condition 
specific data for clinical audit and outcomes _ reporting 
from 1996 onwards. Work is being initiated to involve 
clinicians in defining the necessary data sets. 


Core community data set programme. The_ Effective 
Purchasing and Providing in the Community project (EPPIC) 
is currently working on the inclusion of data on outcomes 
and quality in its development of service profiles. 


Cancer registration. This will in future include more 
information which will enhance the capacity to report 
outcomes on a comparable basis 


OTHER RELATED DEVELOPMENTS 
11. Inthe longer term: 


resource management and clinical information systems more 
generally will make clinical information increasingly 
accessible for audit purposes. CRAG is _ currently 
supporting two pilot sites developing the linkage between 
resource management and audit; 


the electronic patient record will eventually provide the 
structure for implementing local protocols; and 


-8- 


Clinical information systems will provide the facility for 
continuous review and for exception reporting which — will 
identify topics which require more detailed investigation. 


CONCLUSION 


12. In developing clinically relevant outcome _ indicators the 
Working Group and ISD depend on critical and _ constructive 
dialogue with all of the interests involved. We will welcome 
any comments and suggestions about how the work might be 
taken forward. 


——rerotiz, “err 


_ 





Dr Dorothy Moir 

Chairman 

Clinical Outcomes Working Group 
December 1994 
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ANNEX 2 


Technical Annex. Specific Clinical Outcome Indicators. 


The outcome indicators presented in this Annex fall into three groups as follows: 


Page. 
SECTION A Health Board Indicators pS 
1 Teenage conception. 2.4 
2 Therapeutic abortion. aA 
3 Childhood incidence of measles. ZO 
4 Cervical cancer mortality. 24 
> Suicide. 2.8 
6 Diabetic ketoacidosis. 2.9 
7 In-patient stays for children with asthma. 2210 
SECTION B Acute hospital indicators 2.11 
8 Mortality after admission for fractured neck of femur. Zale 
9 Discharge home after admission with fractured neck of femur. 2.16 
10 Mortality after admission for acute myocardial infarction. 21 
11 Reoperation after transurethral prostatectomy. 2.18 


jt Emergency readmission rate after discharge from medical specialty. 2.19 


1) Mortality after admission for stroke. 2.22 
14 Discharge home after admission for stroke. 223 
SECTION C Psychiatric hospital indicators. 2.25 
15 All deaths within one year of discharge. 2.25 
16 Deaths at ages under 65 within one year of discharge. pap es 
17 Suicides within one year of discharge. 0 A 
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SECTION A. Health Board Indicators. 


Introduction. 


The indicators presented in this section relate to the resident population of the Scottish Health 
Boards. 


It is stressed that no direct inferences about quality of care should be drawn from these 
indicators. They are intended rather to highlight issues which may require further 


investigation 


The following indicators are presented: 


1. Teenage conceptions. 
Conceptions per 1000 females aged 13 to 15. 
2. Therapeutic abortion. 
a) Ratio of abortions to live births. 
b) Abortions per 1000 women aged 15 to 44. 
c) Proportion of abortions performed at less than 10 weeks gestation. 
3. Childhood incidence of measles. 
a) Notifications per 1000 children aged under 1 year. 
b) Notifications per 1000 children aged | to 4 years. 
4. Cervical cancer mortality. 
Deaths from cervical cancer per 100,000 women. 
5. Suicides. 
Deaths from suicide per 100,000 population. 
6. Diabetic ketoacedosis. 
Emergency inpatient admissions per 100,000 population. 
7. Inpatient stays for children with asthma. 


Inpatient episodes of four days or more per 1000 children aged under 16 years. 


oe 


General features. 


The indicators at Health Board level presented in this section are of various kinds. However, 
their analysis and presentation have several features in common. 


Areas presented 


Indicators for all Scottish Health Boards including the Island Health Boards are presented in 
the tables. However because of the small numbers involved and the consequently wide 
confidence intervals, the Island Boards are omitted from the graphs. 


Period of coverage. 


Indicators are presented for the three most recent years for which data are available. Numbers 
and rates are presented for the three years separately. A total and an aggregate rate for the 
three years as a whole are also presented. Confidence intervals are given for the three year 
rate. 


Standardisation. 


Where indicators apply to a relatively narrow age range, they are presented as unstandardised 
rates. Thus teenage conception rates, childhood incidence of measles and the incidence of 
longer stays in hospital for children under 16 admitted with asthma are presented 
unstandardised. However, in order to adjust for the effects of the differing demographic 
structures of the Health Boards, the more general rates are directly standardised to the 
population structure of Scotland as a whole in terms of age and sex. 


Confidence intervals. 


95% confidence intervals are presented as an aid to interpretation. They provide no hard and 
fast answers. Some of the variation in the indicators presented - whether over time or between 
Health Boards - is due to random factors. The influence of these random factors will be 
proportionately greater the smaller the numbers of events involved. Confidence intervals thus 
express the fact that more credence can be placed in an indicator based on large numbers than 
on one based on small numbers of events. 


Where the Scottish mean lies outwith the confidence intervals for a particular Health Board 
indicator, there is a strong probability that the deviation is due to factors other than random 
variations in the data. However where the Scottish mean lies within the confidence interval for 
a particular Health Board indicator, this does not necessarily mean that the deviation can be 
ignored. Factors other than random variation may well be involved. 


Data sources. 


The indicators are derived from Scottish Morbidity Records held at ISD and from population 
and death data used by kind permission of the Registrar General for Scotland. 


rs S, 


Teenage conceptions 


Definition: Rate of conceptions at ages 13 to 15 years 

Period covered: 1990 to 1992 

Source: SMR1 and SMR2 records 

Standardisation: Unstandardised rates 

Comment: These figures represent the age at which young girls become 


pregnant: some will go on to deliver, others will have a 
termination of the pregnancy or miscarry. Some of these events 
will occur after the girls have reached the age of sixteen. The 
prevention of pregnancy in underage girls is complex and 
sensitive but will involve attitudes in the home, health education 
in schools and the availability of contraceptive services. 
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Therapeutic abortion. 


Definition: 


Period covered: 


Source: 


Standardisation: 


Comment: 


Three aspects of the pattern of therapeutic abortion are 
presented: 


a) Ratio of abortions to live births 

b) Abortions per 1000 women aged 15 to 44 years 

c) Proportion of abortions performed at less than 10 weeks 
gestation 


1991 to 1993 


Notification (to the Chief Medical Officer, SOHHD) of 
abortions performed under the Abortion Act 1967. 


a) Unstandardised ratio of abortions to live births 
b) Age standardised abortion rate 
c) Unstandardised proportion of abortions 


Termination of pregnancy is carried out for an unwanted 
pregnancy in the great majority of cases. It should be possible 
to reduce the abortion rate by making available appropriate 
contraceptive services and by health education. But care must 
be taken in the interpretation of differing abortion rates. For 
example, there may be population differences in the acceptability 
of abortion or there may be inadequate provision of abortion 
services. 


Morbidity is reduced by early termination of pregnancy and the 
proportion of abortions performed at less than 10 weeks is an 
indicator of well organised access to, and delivery of, the 
service. 
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Childhood incidence of measles 


Definition: 


Period Covered: 


Source: 


Standardisation: 


Comment: 


Confirmed notification of measles for children aged under 1 year 
and aged | to 4 years 


1991 to 1993 


ISD(D)3 Notifications of Infectious Disease 


Unstandardised rates of notification per 1000 children in the 
same age groups. 


Measles is a highly contagious viral illness. Complications may 
include bronchopneumonia, convulsions and_ encephalitis. 
Encephalitis is a rare complication(1 in a 1000 cases) but can 
cause death in 15% and long term neurological problems in 25% 
of cases. 


Notifications, as a means of determining incidence, 
underestimate the scale of the problem. Changes in notification 
rates are used to monitor epidemics, and the absence or 
reduction of cyclical peaks is probably a good indicator of a 
reduced incidence of measles. More subtly, changes may be due 
to changes in notification practice by staff. Children should be 
immunised around the age of 12 to 15 months and therefore 
may be unprotected during their first year of life apart from 
maternal antibodies transferred to them. However, if 
immunisation rates are high in the population, the “herd 
immunity” should protect the unimmunised infant from coming 
in contact with measles. Measles in the 1 to 4 year age group 
should not occur in children who have been immunised. 
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Cervical cancer mortality 


Definition: 


Period Covered: 


Source: 


Standardisation: 


Comment: 


Death rate per 100,000 female population from cervical cancer 
at all ages 


1991 to 1993 


GRO(S) 


Rates directly standardised to age structure of Scottish female 
population 


Premalignant changes in cervical cytology are usually present 
and detectable for several years before an invasive lesion 
becomes clinically apparent. Cervical screening is an effective 
measure for an individual woman because early treatment is 
largely successful and therefore death from cervical cancer is 
largely preventable. This is reflected at the population level 
where cervical screening is effective in reducing death rates if 
coverage is high. 
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Suicide 


Definition: 


Period Covered: 


Source: 


Standardisation: 


Comment: 


Deaths coded E950-E959 = (suicide and self-inflicted injury) 
or E980-E989 (injury undetermined whether accidentally or 
purposely inflicted) 


1991 to 1993 


GRO (Scotland) 


Rates directly standardised to age and sex structure of Scottish 
population. 


The diagnosis of suicide involves a judgement about the prior 
intention of the person involved as reflected in the form of 
words used on the death certificate. Thus, it is generally 
considered that explicit codes for suicide and self-inflicted injury 
underestimate the frequency of suicide. In order to reduce any 
such underestimation, this indicator includes deaths with codes 
which cover both ‘suicide and self inflicted injury’ and ‘injuries 
undetermined whether accidentally or purposely inflicted.’ The 
latter codes may involve incidents between two or more people 
and other events which clearly could not be suicide. 


28 


Yoda siyj} ul uaAi6 souepinb oij199ds 94} puke jeJ9UaH 94} YIM 
eouepsozoe UI Aj}9113S pajaidsa}Ul aq pjnoys UONPWIOJUI SIUE =: SNINNWM 


lst 6LL QSL Le ZOvZ =s-« 906 962 002 pue}}oos 
Z'0 1°62 O'SL v'OL 9°01 vez ZL 3 € Sw. S9|S| Wasa 
LL Z 61 est SSL Sr 621 OSL Zl gc oS apiske | 
00 1°92 9b 38 SOL 00 js Zz € Zz puejjayus 
00 9°0€ SEL 8°2Z Z6 9'OL g v Zz Zz KauxXlo 
eZ ISEL O'SL elt ZS 971 Ore ZeL vd 16 ueIY}OF 
68 or SLL Zl 66 LeL 861 69 SS vl aJIYSyJeuey 
9'9L 8°62 rAd se A 6'€z Ce 8°8z rA'as 6P Ge gg pue|ybiy 
OLL 8'7Z 6°61 ad 012 SOL Svs 702 C61 LSL Mobse|5 Ja}Ba5 
SOL 6°91 Leb Z SL Z SL elt 912 82 6 6S ueidwels 
£6 O'eL ipsa} OLL O'-LL SZ ZLL SP 0¢ ve Aa|jeA yoy 
16 SLL 9°EL Zr O'Sl SLL cr 6P ras) Ly os 
£6 G7 6°SL Zl2 O'eL SEL 89 O€ 8} 0z AemojleS 9 salijwing: 
88 vz 9°91 Sel 1°02 ysl vS GL ce LL sJaplog 
86 OL Seb O91 SEL OL LSI 6S LS Ly UB 9 allyssAy 
O'eL 1°02 3°91 abe Let Ol 81z Z6 8. SP apA|o 9 ||ABuy 
TI%SE ‘rd %GE €661 0} €66L 7661 L661 £661 0} €66L  Z661 L661 pseog yea} 
Jamo} Jaddn L661 L66L 

uoljejndod 000‘00L Jad 3}e1 pesipsepuejs “S9pldins jo J3quinn 
“C66L 9} LE6L “‘Spieog Yj}/e9}yH pue puejj}o9S 


“SOPIIINS "G 8/1Ge] 


souepinb d1y19E8ds ay} pue jesoUSH 9y} YyIM BDUePsJOIIR Ul Aj}91}S po}o1d49}UI 9q PjNoYUSs UOHeWOJUI SIU] 


9}E1 YS!I}}OIS —— 
TD %S6 JOMO] 


ayey pueog yyeeH e@ 
1D %G6 Jeddyn 





apishel 


ueIY}07] 


yoda siy} ul UdAIB 


aduapIsay jo pueog UJeaH 


a 

ml 

o 
_ a 

@ 
@ s 
FA =e a . 
* 2 a 3 
a =r # 3 
3 : een: 
o rom = 3 

$$ p $$ 





payebaibbe e661 0} L661 
saploins 


AayeA yyos 


a4 


g ounbi4 


Aemojjes 9 saujuing 


siapiog 


- SNINYVM 


uBLY 9 sysiAy 


apAlo 8 11ABiy 


Ol 


SI 


02 


Sc 


O€ 


uoiejndod 900‘00} Jed ayes Apljewow pasipsepuerys 


Jc “28 ms “_— i a 
ster en ae 7 
amen out pur (ae 
reece, 99 PyeS UCRMsOIN; cut 














“Zz am “a 






ed i $ n E 
: : 5 7 : 5 2 
2 4 : % . 
7 « A * > 
3 = 6 “ > : s he ? 
re E ry a 
e 5 $ 2 
3 = 
3 a & = pa 
_ a omy - Lape 
= wf 7 ad @ nq 3 ? be — 
c ¥ < = 
, > a 










L 






oot sonshiseh Yo bino€ ritisoh 


7 qe rt? bins Isroney ort ritiw sangbrooss ni yorde betewqtetni sd blucde noBemomi ait : OVA 
ais _ ; Hoge, aint ai nevip 
, oat ome) 








7 


Diabetic ketoacidosis 


Definition: 


Period Covered: 


Source: 


Standardisation: 


Comment: 


Emergency inpatient admissions with a main condition of 
diabetic ketoacidosis (250.1) or diabetic ketoacidosis with coma 
(250.2). 


Episodes with a discharge date in the calendar years 1991 to 
1993 


SMRI1 records 


Rates directly standardised to Scottish population structure in 
terms of age and sex. 


Diabetic ketoacidosis is a medical emergency and the data 
shown here are episodes not people. Some of these episodes 
are due to “brittle” diabetes which is difficult to control, others 
occur because the individual with diabetes has been less 
successful in balancing diet, exercise and insulin requirements. 
Differences between boards may also involve failure of support 
and advice to diabetic patients who have to learn to manage 
their own disease. 


The rates are based on the whole population and not the 


diabetic population and there are known to be differences in the 
urban: rural prevalence of diabetes. 
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In-patient stays for children with asthma 


Definition: 


Period Covered: 


Source: 


Standardisation: 


Comment: 


Number of inpatient episodes of 4 days or more among children 
under 16 years admitted for asthma per 1,000 children aged 
under 16 years. 


1991 to 1993 
SMRI1 records. 
Unstandardised rates. 


Asthma is a common cause of morbidity, and research suggests 
that the incidence and severity of asthma has been rising over 
the last 15 to 20 years. Deaths from asthma should be largely 
preventable by good management in primary and secondary 
care. “Good” care may be achieved by offering asthma sufferers 
open access to specialist clinics or wards in an emergency. Thus 
shorter admissions for rapid control and relief of symptoms are 
excluded from this indicator. Episodes of care with a length of 
stay of 4 days or more have been taken as an indicator as they 
may represent a severe and intractable episode which might 
have been prevented with prompt early intervention. 


The table and graph show a clear contrast between four 
mainland Boards with a high incidence of longer stays and the 
rest. The reasons for this marked contrast and the extent to 
which it may reflect different approaches to the management of 
asthma are not yet understood. 
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SECTION B. Indicators for acute hospitals 


Introduction 
This section presents seven outcome indicators relating to patients treated in acute hospitals. 


The first five indicators were reported at Health Board level in the CRAG Clinical Outcomes 
Working Group report of June 1993. Much of the interpretative material given here is derived 
from working with these indicators at hospital and Health Board level and discussing them 
with a range of clinical and public health specialists. We are grateful to all those who have 
provided feedback on various aspects of the indicators. 


It is stressed that no direct inferences about quality of care should be drawn from these 
indicators. They are intended rather to highlight issues which may require further 
investigation 


In particular it should be noted that certain hospitals are divided between different trusts 
according to specialty. This has implications for the meaning of the outcome indicators in 
terms of patterns of patient management and case mix. 


General features of the indicators. 


The following points apply to all seven of the outcome indicators presented: 


Period of coverage 


The indicators presented here are based on data for a three year period ending at varying 
points in 1993. The linked data set from which the indicators are derived currently contains 
data on discharges and deaths up to the end of 1993. 


The possibility of producing more up-to-date indicators is limited by the present annual cycle 
of record linkage and the fact that the indicators are derived from hospital discharge records. 
Quarterly linkage of data is planned by 1995 which should enable much more rapid follow up 
of outcomes. 


Cases are identified from SMRI1 records which are discharge records. Thus there is 
information only on episodes of care which were completed (the patient had been discharged) 
by the end of 1993. Analyses were carried out on data from earlier years for each indicator in 
order to determine the interval necessary to ensure that an adequate proportion of cases 
(minimum 99%) was being captured. The periods adopted for each indicator reflect these 
analyses. 
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Standardisation. 


Rates have been standardised using direct standardisation to the Scottish age and sex structure 
for the outcome indicator in question. Thus for mortality after acute myocardial infarction, 
rates are standardised to the age and sex structure of all patients in Scotland admitted for 
acute myocardial infarction in the given time period. 


The first five indicators are standardised in terms of age and sex. Indicators 13 and 14 for 
stroke are also standardised in terms of the ICD9 3-digit condition code. 


Confidence intervals 


Since the indicators presented are based on complete enumeration rather than sampling, a case 
could be made that it is inappropriate to present confidence intervals based on sampling 
theory. However there is also an argument that many of the unmeasured or unmeasurable 
factors which influence outcome are likely to vary in a random fashion. The influence of these 
random factors will be proportionately greater the smaller the numbers of events involved. 
Confidence intervals are therefore presented as an aid to assessing the likely effect of random 
fluctuations on the data. The confidence intervals are calculated using the square root 
transform method. 


Even where the Scottish mean lies within the confidence interval for a particular unit, factors 
other than random variation in patient characteristics may well be involved. Where the Scottish 
mean lies outwith the confidence intervals for a particular unit, this means that there is a strong 
probability that the deviation is due to factors other than random variations in the data. 


Data sources 


All analyses are based on data contained in the linked data set of morbidity records generated 
and maintained by ISD and the Data Centre of the Common Services Agency. The linked data 
set contains death records and this, as well as their use in analysis, is by permission of the 
Registrar General for Scotland. 


The mortality rates presented here are based on linkage to the Registrar General's death 
records and thus take account of all deaths and not only those occurring in hospital. 


A full description of the Scottish record linkage system is contained in the Health Bulletin, 
March 1993. 


Patient-based indicators. 


With the exception of emergency readmissions to medical specialties, all of the indicators are 
patient-based. In other words each patient satisfying the criteria for entry is included once and 
once only. For example, if a patient has been admitted with acute myocardial infarction three 
times in the period of coverage only the first admission will contribute to the outcome 
indicator for acute moyocardial infarction. 


pEN ee 


Definition of provider units. 


Trusts and directly managed units are as constituted on 1st August 1994. Where a constituent 
hospital closed before that date, figures for that hospital are not included. 


Provider units included. 


For each indicator a threshold has been chosen in terms of the number of index events. The 
threshold for inclusion is chosen partly in order to include only units with sufficient numbers 
of events and partly so that the units selected broadly correspond to the major adult acute 
hospitals. In the case of the two pairs of related indicators - those for fractured neck of femur 
and those for stroke - the same sets of units are presented for both. With this exception, the 
provider units presented for each indicator will vary. The thresholds for presentation of results 
are as follows: 


Indicator 8. Mortality after fractured neck of femur. 200 events 

Indicator 9. Discharge home after fractured neck of femur. Same units as Indicator 8. 
Indicator 10. Mortality after AMI. 400 events 

Indicator 11. Reoperation after TURP 100 events 

Indicator 12. Emergency readmissions 5000 events 

Indicator 13. Mortality after stroke 500 events 

Indicator 14 Discharge home after stroke Same units as Indicator 13. 


The provider units are presented in order of Health Board cipher. 


Presentation. — 


For each of the seven indicators the following information is provided. 


a) 


Tables 


The number of patients or events for which an outcome has been assessed is given 
first. This is followed by the number of ‘outcome events’, e.g. deaths within thirty 
days of admission for acute myocardial infarction, and the unstandardised rate of 
these events. 


The outcome indicator takes the form of the rate standardised for the age and sex 
composition of the patients involved (see section on standardisation above for details). 


In addition, the lower and upper 95% confidence intervals for the standardised 
outcome indicator are provided (see above for discussion) 


For each indicator the Scottish totals and mean rate is given. The Scottish figures are 
derived from all relevant events including those occurring in units where numbers are 
too small to be presented individually. 
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b) Comparative graphs 


The graphs present the standardised outcome indicators for each provider unit along 
with the 95% confidence intervals. The Scottish mean for the indicator is presented as 
a reference point in the form of a horizontal line. 


Validation or further analysis 


ISD wishes to be of assistance in any way it can in the validation of the data involved in these 
indicators, in the further exploration of factors involved in variations and in any other technical 
issues which arise from local discussion. For example, ISD can provide trend data of the 
indicators at provider unit level or diagrams showing patient pathways in more detail. 


Contacts: Stephen Kendrick 031 552 6255 x 2441 
James Boyd we i 


Fax 031 551 1392 
Information and Statistics Division 
National Health Service in Scotland 
Trinity Park House 
South Trinity Road 
Edinburgh EHS 3SQ 
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8. Mortality after admission for fractured neck of femur. 


Deaths occurring within 30 days of admission as percentage of all admissions with 


fractured neck of femur 


Inclusion criteria: 


Outcome: 


Discussion : 


Inpatients admitted with a principal diagnosis of fractured neck 
of femur (ICD9 code 820) between July 1990 and June 1993 
inclusive. 


Where a patient has more than one episode with a diagnosis 
of fractured neck of femur in the period, only the first one is 
used. 


The outcome is defined as death from any cause, in hospital or 
elsewhere, within 30 days of admission. 


For this indicator aspects of case mix are likely to be particularly 
important in determining outcome. 


Work is currently under way to incorporate categories of prior 
and comorbidity into the standardisation model. 


In addition, attention is being paid to the problem of classifying 
patients according to residential origin. It is possible that 
patients admitted from residential care may have characteristics 
affecting outcome. At present the SMRI record cannot 
differentiate between patients admitted from their own home 
and those admitted from residential care. The possibilities of 
making this distinction based on residential postcode are being 
explored. 
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9. Discharge home after admission with fractured neck of femur. 


Percentage discharged home within 56 days of emergency admission from home with 


fractured neck of femur. 


Inclusion criteria: 


Outcome: 


Discussion : 


Inpatients admitted as emergencies from home with a principal 
diagnosis of fractured neck of femur (ICD9 code 820) in the 
three years between July 1990 and June 1993. 


Where a patient has more than one episode with a diagnosis of 
fractured neck of femur in the period, only the first one is 
included. 


The outcome is defined as discharge home within 56 days or 
eight weeks of admission. 'Home' is defined on the SMRI1 
record as ‘usual address’. This includes all places of residence or 
care other than NHS in-patient facilities. Thus private or local 
authority nursing homes are included in the definition of home. 


For this indicator, as for indicator 8, aspects of case mix are 
likely to be particularly important in determining outcome. 


Work is currently under way to incorporate categories of prior 
and comorbidity into the standardisation model. 


In addition, attention is being paid to the problem of classifying 
patients according to residential origin. It is possible that 
patients admitted from residential care may have characteristics 
which affect outcome. At present the SMRI1 record cannot 
differentiate between patients admitted from their own home 
and those admitted from residential care. The possibilities of 
making this distinction based on residential postcode are being 
explored. In addition, differentiation of destination in terms 
of the patient’s own home versus further residential care would 
be desirable. 
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10. Mortality after admission for acute myocardial infarction. 


Deaths occurring within 30 days of admission as a percentage of all admissions 
with acute myocardial infarction 


Inclusion criteria: Patients admitted with a principal diagnosis of acute 
myocardial infarction (ICD9 code 410) between October 
1990 and September 1993 inclusive. 


The first admission in the period for each patient is 
included. 


Outcome: The outcome is defined as death from any cause, in 
hospital or elsewhere, within 30 days of admission. 


Discussion 


This indicator has been subject to considerable further analysis and discussion with 
clinicians and public health specialists. 


ib Analysis has been carried out to explore the effect of coded comorbidity and 
prior morbidity. Cases were categorised according to the presence of 
diagnostic categories as secondary diagnoses on the index record or in any 
position on any SMR1 and SMR6 records in the previous five years. Thus it 
has been possible to standardise for the presence of or a history of neoplasms, 
heart disease, circulatory and respiratory conditions or any other diagnosis. 
Such additional standardisation has made very little difference to the mortality 
rates presented in this report which are standardised for age and sex only. 


Z Similarly it has been possible to standardise for the Carstairs deprivation 
category of the postcode sector of residence according to the 1991 Census. 
This additional control makes even less difference than does standardisation for 
comorbidity and prior morbidity. 


3. Another aspect of case mix is that particular hospitals may have higher 
apparent mortality rates because they admit higher proportions of patients with 
second or subsequent heart attacks with associated poorer survival prospects. 
This was tested by restricting the analysis to patients with no previous heart 
attacks for seven years beforehand. Again the results were very little different 
to those presented here. 


Zag 


If any provider would like to see their results standardised for prior and 
comorbidity and deprivation category, or restricted to first heart attacks, ISD 
wil! be happy to provide the figures. 


A possible confounding factor has been suggested whereby those units which 
are more successful in getting more serious cases to hospital might have this 
success reflected in higher mortality rates - the so called ‘fast ambulance’ effect. 
It is not possible to test this effect at provider level since a precisely defined 
population denominator is required. However an initial analysis was possible at 
Health Board level. An estimate of the total number of AMIs was obtained by 
adding together a) deaths with principal cause of death of AMI for those cases 
not admitted to hospital and b) admissions to hospital with principal diagnosis 
of AMI. Thus it was possible to calculate the proportion of all AMI cases 
admitted to hospital. By comparing this proportion with the 30 day mortality 
rate it was possible to test the fast ambulance hypothesis. In fact those Health 
Boards which admitted to hospital the highest proportion of AMIs were also 
those with the lowest mortality rates i.e. data demonstrated the reverse of the 
fast ambulance effect. 


It has been possible to explore the above possible confounding factors on the 
basis of administrative data. However a further factor may be involved which 
cannot be explored in this way. This involves different admission or diagnostic 
thresholds for acute myocardial infarction. Indirect evidence suggests that it is 
possible that some units admit higher proportions of relatively mild or 
borderline AMI cases. This will obviously give rise to lower mortality. Other 
units may have relatively high thresholds for admission or coding of acute 
myocardial infarction so that only relatively more serious cases with poorer 
prognosis are admitted. This issue is recommended as a primary focus for 
further research. 


The analyses reported above have been carried out by statisticians at ISD and 
by public health medicine specialists in the Scottish Office Home and Health 
Department and at the University of Edinburgh. Their report has been 
submitted for publication. This work in particular has been illuminated by the 
feedback from individual clinicians in relating the outcome indicators to their 
experience. 


A further phase of analysis will explore the influence of aspects of service 
organisation on clinical outcome for AMI, for example in terms of the influence 
of the presence or absence of a cardiology department or the organisation of 
intensive therapy services. 


A number of hospitals are using a process measure as an indicator of quality of 
care and as a proxy for outcome, namely “door to needle time” for the 
administration of thrombolytic therapy. This is a simple indicator likely to be 
derived from normal clinical records which is appropriate for universal 
adoption. 
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11. Reoperation after transurethral prostatectomy. 


Reoperation within one year of transurethral prostatectomy. 


Inclusion criteria. 


Outcome: 


Discussion: 


All patients aged 55 to 84 undergoing transurethral 
prostatectomy (OPCS3 code 633, OPCS4 code M65) in 
the three years from 1990 to 1992. The first 
transurethral prostatectomy in the period is regarded as 
the index. Cases are excluded if there is a diagnosis of 
prostate or bladder cancer at any time in the period 1981 
to 1992. 


The outcome is defined as the performance of a further 
prostatectomy (transurethral or open) within one year of 
the index operation. 


This indicator may indicate differences in clinical 
practice. Interpretation of this indicator in particular 
requires clinical expertise. 


In addition this is the only indicator where the outcome 
event itself is dependent upon the accurate coding of a 
procedure. Thus the indicator is especially vulnerable to 
errors in the coding of the reoperation record. 
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12. Emergency readmissions after discharge from a medical specialty. 


Proportion of patients readmitted within 28 days of discharge from inpatient 


care in a medical specialty. 


Inclusion criteria: 


All patients discharged from a medical specialty (coming 
to the end of a spell of continuous in-patient care) 
between October 1990 and September 1993 are 
included. 


Medical specialties are defined as follows: 


General Medicine 
Cardiology 
Metabolic Disease 
Gastroenterology 
Poisons Unit 
Nephrology 
Rheumatology 
Respiratory Medicine 
Genito-Urinary Medicine 
Homeopathy 
Medical Oncology 
General Practice 
Other Acute 


This corresponds to the grouping ‘Medicine - other' 
defined in the volume ‘Scottish Health Costs' of 1990. 
The grouping is aimed at avoiding inconsistencies due to 
variations in the extent to which some of the smaller 
specialties have a separate existence in different provider 
units. 


The continuous in-patient stay is a continuous spell of 
in-patient treatment which may span episodes in 
different specialties or hospitals.. Patients are allocated 
to the specialty and provider unit of the discharge 
episode, the final episode in the stay. 


Cases where patients are discharged dead or where 


death occurs within 28 days of discharge are excluded 
from the analysis. 


2.20 


Outcome: 


Discussion : 


The outcome is defined as emergency admission as an 
in-patient within 28 days of discharge. Readmission may 
be to any hospital or specialty in Scotland for any 
diagnosis. 


Further analysis is beginning to suggest that emergency 
readmission within 28 days of discharge from a medical 
specialty should not be interpreted solely in the context 
that one particular discharge. Such emergency 
readmissions should not be seen primarily as reflecting 
failure of treatment in one inpatient stay but rather as 
elements of what are often long and complex patient 
histories involving multiple stays in hospital. 


Trend analysis suggests that the increase in the 
emergency readmission rate within 28 days of discharge 
is largely a reflection of increasing numbers of patients 
with long and complex treatment histories. In other 
words, as we see larger numbers of patients who are 
each experiencing patterns of admission which involve 
repeated emergency admissions, the 28 day emergency 
readmission rate may well be increasing primarily as a 
by-product of this trend. 


Thus this indicator is likely to be a reflection more of 


wider patterns of treatment and patient history rather 
than of quality of care in a single stay in hospital. 
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National Health Service in Scotland 
Management Executive 


INFORMATION SERVICE 
2¢3DEC 1994 





Dear Colleague ‘Wellcome Centre for Medical Science | 





CLINICAL OUTCOME INDICATORS 


Summary 


ess Health Boards were invited, in MEL(1992)87, to 
include in contracts for 1993/94, and subsequently, 
the clinical outcome indicators recommended by the 
Clinical Outcomes Working Group of CRAG, and to 
take certain other action in relation to the 
management of clinical information. The results 
for 5 of the specific indicators recommended were 
published, at Health Board level, in June 1993 
along with MEL(1993)93. The attached report 
updates these 5 indicators which are now presented 
for each NHS Trust providing services in the 
relevant specialties. To these have been added 

12 further indicators including 7 in public health 
medicine and 3 in psychiatry. 


Action 


Variations between hospitals 


CHR No direct inferences can be drawn about the 
quality of clinical care in different hospitals or 
health board areas on the basis of the information 
provided. This is because these clinical outcome 
indicators do not provide directly comparable 
information either about the efficacy of treatment 
for a particular condition in different hospitals or 
about the effectiveness of services provided for the 
inhabitants of different health board areas. 
Variations in clinical outcome may be due to the 
relative quality and completeness of the data 
supplied by hospitals and health boards to ISD for 
the Scottish Morbidity Record (SMR), local case 
mix, geographic variations in disease, 
socio-economic and other factors. The indicators 
are being published now with the specific aim of 
stimulating local discussion about the possible 
reasons for any apparent variation so that this may 
be investigated and appropriate action taken; for 
example by setting in train a clinical audit to 
identify the likely cause of the disparity. 
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Quality of data and related activity 


3. The first of the Working Group's original recommendations in 1992 to 
be included in contracts for 1993-1994 was that a structured review 
should be carried out of the quality of the data supplied to ISD. Health 
Boards are asked to review the position and to request the results of this 
review of data quality in the hospitals in their area. Boards are asked to 
report back to ISD on the outcome of this review by 30 September 1995. 
Boards are also asked to initiate local discussions about the use of 
outcome measures in general and about issues arising from the specific 
indicators included in the report and to report back to CRAG on progress 
by the same date. These discussions should involve Directors of Public 
Health, local Trusts and other hospital units, professional clinical staff, 
general practitioners, professional advisory and clinical audit committees, 
and other relevant local interests, including patient representatives. 


4. Finally Boards and GP fundholders are asked to make known to 
CRAG any outcome indicators in use or under development locally, so that 
they may be considered by the Clinical Outcomes Working Group for 
possible wider use. 


Use of outcome indicators 
5. Specific attention is drawn to the care with which these indicators 
must be interpreted in the light of all local circumstances. They should 


not be used as the basis for inappropriate or premature conclusions about 
which health boards or which hospitals provide the best health care. 


Rlet keutell 





R E KENDELL GEOFF SCAIFE 
Chief Medical Officer Chief Executive 
NHS in Scotland 
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October 1990 to September 1993 








Proportion of patients readmitted within 28 days of discharge from inpatient care in a 
medical specialty. 


Figure 12 
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13. Mortality after admission for stroke. 


Deaths within 30 days of emergency admission for stroke. 


Inclusion criteria: 


All patients admitted as emergencies with a principal diagnosis of 
stroke (ICD9 codes 430-434, 436-438) in the period July 1990 to 
June 1993. 


This is a relatively wide definition of stroke and includes the 
following conditions: 


ICD9 code 430 Subarachnoid haemorrhage 

ICD9 code 431 Intracerebral haemorrhage 

ICD9 code 432 Other and unspecified intracranial haemorrhage 
ICD9 code 433 Occlusion and stenosis of precerebral arteries 
ICD9 code 434 Occlusion of cerebral arteries 

ICD9 code 436 Acute but ill-defined cerebrovascular disease 
ICD9 code 437 Other and ill-defined cerebrovascular disease 
ICD9 code 438 Late effects of cerebrovascular disease 


Additional standardisation: 


Discussion.: 


As well as being standardised in terms of age and sex, as are the 
other indicators for acute hospitals, this indicator is also 
standardised in terms of the 3-digit condition codes listed above. 


Because the term ‘stroke’ is a shorthand for a range of conditions 
of differing severity it is possible that mortality differences 
between providers are influenced by differences in the mix of 
these conditions. Analysis has shown that the degree of such 
variation is relatively small in terms of ICD9 3- digit coding. 
However as an additional safeguard against the effects of case 
mix, standardisation in terms of ICD9 three digit coding is 
incorporated into this indicator. 


This does not rule out, of course, the possibility that differences in 
mortality may be attributable to other factors such as elements of 
case mix which are not captured by ICD9 3-digit coding, 
differences in coding procedure or differences in admission 
thresholds for stroke. 
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14. Discharge home after admission for stroke. 


Proportion of patients discharged home within 56 days of emergency admission 
from home with stroke. 


Inclusion criteria: 


Outcome: 


All patients admitted as emergencies from home with a principal 
diagnosis of stroke (ICD9 codes 430-434, 436-438) in the period 
July 1990 to June 1993. 


This is a relatively wide definition of stroke and includes the 
following conditions: 


ICD9 code 430 Subarachnoid haemorrhage 

ICD9 code 431 Intracerebral haemorrhage 

ICD9 code 432 Other and unspecified intracranial haemorrhage 
ICD9 code 433 Occlusion and stenosis of precerebral arteries 
ICD9 code 434 Occlusion of cerebral arteries 

ICD9 code 436 Acute but ill-defined cerebrovascular disease 
ICD9 code 437 Other and ill-defined cerebrovascular disease 
ICD9 code 438 Late effects of cerebrovascular disease 


The outcome is defined as whether a patient is discharged home 
within 56 days or eight weeks of admission. 'Home' is defined on 
the SMR1 record as ‘usual address’. This includes all places of 
residence or care other than NHS in-patient facilities. Thus private 
or local authority nursing homes are included in the definition of 
home. 


Admission from home: 


It should be stressed that this indicator applies only to patients 
admitted as emergencies from ‘home’ (as discussed above) as 
compared to indicator 13, mortality after admission with stroke, 
which applied to all emergency admissions. Thus the number of 
index cases differs. 


Additional standardisation: 


Discussion: 


As well as being standardised in terms of age and sex, as are the 
other indicators for acute hospitals, this indicator is also 
standardised in terms of the 3-digit condition codes listed above. 


Because the term ‘stroke’ is a shorthand for a range of conditions 
of differing severity it is possible that differences between 
providers in the discharge home rate are influenced by differences 
in the mix of these conditions. Analysis has shown that the degree 
of such variation is relatively small in terms of ICD9 3-digit 
coding. However as a safeguard against the effects of case mix, 


eee 


standardisation in terms of ICD9 three digit coding is 
incorporated into this indicator. 


This does not rule out the possibility that differences in the 
discharge home rate may be attributable to other factors such as 
elements of case mix which are not captured by ICD9 3-digit 
coding, differences in coding procedure or differences in 
admission thresholds for stroke. A particularly important problem 
in the case of this indicator is caused by the wide definition of 
‘home’ on the SMR1 form which includes private and local 
authority nursing homes. Thus differences in patient management 
and discharge opportunities may influence the apparent discharge 
home rate. 
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SECTION C Indicators after psychiatric inpatient care. 
Deaths within one year of discharge from psychiatric inpatient care. 


Introduction 


The indicators presented in this section represent three aspects of mortality in the year 
following discharge from psychiatric inpatient care. 


The indicators are: 


15 All deaths within one year of discharge from a psychiatric hospital or unit per 
1000 person years at risk. 


16 Deaths at ages under 65 years within one year of discharge from a psychiatric 
hospital or unit per 1000 person years at risk. 


17 Suicides within one year of discharge from a psychiatric hospital or unit per 
1000 person years at risk. 


It is stressed that no direct inferences about quality of care should be drawn 
from these indicators. They are intended rather to highlight issues which may 
require further investigation 


General features of the indicators. 
Period of Coverage 


Even when all deaths are included, the number of events is relatively small. For this 
reason it was felt necessary to include five years of discharges. The linked data set of 
SMR4 (psychiatric inpatient) and death records currently runs until the end of 1992. 
Thus patients discharged from the beginning of 1988 to the end of 1992 are included. 


Selection of cases 

Patients discharged from inpatient care in a psychiatric hospital or a psychiatric unit in 
a general hospital were included in the reporting. However, patients who were coded 
dead on discharge or who died on the day of discharge were excluded from the 
reporting. 

Data sources. 

The indicators are derived from the linked data set of SMR4 (psychiatric inpatient) and 


deaths records held at ISD. The latter are used by kind permission of the Registrar 
General for Scotland. 


PES in 


Rates per 1000 person years at risk. 


For the indicators of mortality for non-psychiatric acute care such as death within 30 
days of admission for acute myocardial infarction, the relatively short period of follow- 
up meant that it was legitimate to include only one admission for each patient and for 
the denominator to be the number of patients. 


However patients receiving psychiatric inpatient care may be discharged and 
subsequently readmitted several times in the period under observation (here the period 
1988 to 1992). Thus the time at which patients are ‘at risk’ i.e. within one year of 
discharge may vary between patients. To take simply the number of patients as the 
denominator of the indicators would be to allow them to be distorted by the balance 
between patients discharged only once and patients discharged several times in the 
period. 


Thus, for the present indicators the denominator of the indicator must be ‘person 
years at risk’ rather than simply patients or discharges. Thus the indicators are 
presented in terms of deaths or suicides per 1000 person years at risk. 


Standardisation 


Rates given are standardised by age and sex to the Scottish total of person years at risk 
using the indirect method of standardisation. 


Confidence Intervals 


95% confidence intervals for the rates (standardised by age and sex) were calculated 
using a formula for the standard error derived from the standardised ratio, comparing 
the observed number of cases with that expected. 


Since the indicators presented are based on complete enumeration rather than 
sampling, a case could be made that it is inappropriate to present confidence intervals 
based on sampling theory. However there is also an argument that many of the 
unmeasured or unmeasurable factors which influence mortality are likely to vary in a 
random fashion. The influence of these random factors will be proportionately greater 
the smaller the numbers of events involved. Confidence intervals are therefore 
presented as an aid to assessing the likely effect of random fluctuations on the data. 


Even where the Scottish mean lies within the confidence interval for a particular 
hospital or unit, factors other than random variation in patient characteristics may well 
be involved. Where the Scottish mean lies outwith the confidence intervals for a 
particular unit, this means that there is a strong probability that the deviation is due to 
factors other than random variations in the data. 


220 


Hospitals or units included. 


In the interests of including only hospitals and units with sufficiently large numbers of 
patients to allow meaningful comparison we have included only those which contribute 
more than 1000 person-years at risk for persons of all ages. 


This selection criterion means that the twenty largest psychiatric hospitals have been 
included as well as nine psychiatric units within other hospitals: 


Psychiatric hospitals. Psychiatric units within general 
hospitals. 

Ailsa Hospital, Ayr 

Dingleton Hospital , Melrose Crosshouse Hospital, Kilmarnock 

Argyll and Bute Hospital, Inverclyde Royal Hospital, Greenock 
Lochgilphead Royal Alexandra Hospital, Paisley 

Dykebar Hospital, Paisley Victoria Hospital, Kirkcaldy 

Stratheden Hospital, Cupar Queen Margaret Hospital, Dunfermline 

Woodilee Hospital, Lenzie Parkhead Hospital, Glasgow 

Leverndale Hospital, Glasgow Stobhill Hospital, Glasgow 

Gartnavel Royal Hospital, Glasgow Southern General Psychiatric Unit, 

Craig Dunain Hospital, Inverness Glasgow 

Hartwood Hospital, Shotts Monklands Hospital, Airdrie 


Kingseat Hospital, Aberdeenshire 
Royal Cornhill Hospital, Aberdeen 
Rosslynlee Hospital, Roslin 

Royal Edinburgh Hospital 

Bangour Village Hospital, Broxburn 
Royal Dundee Liff Hospital, Dundee 
Strathmartine Hospita!, Dundee 
Sunnyside Royal Hospital, Montrose 
Bellsdyke Hospital, Larbert 
Crichton Royal Hospital, Dumfries 


Definition of suicide for indicator 17 


Deaths were classed as ‘suicide’ when they were coded on the death record with the 
following E (external cause) codes: 


E950-E959 (suicide and self-inflicted injury) and 
E980-E989 (injury undetermined whether accidentally or purposely inflicted) 


‘It is generally considered that explicit codes for suicide and self-inflicted injury 


underestimate the frequency of suicide. Therefore it is usual to include E980-989 
(injury undetermined whether accidentally or purposely inflicted). 
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CLINICAL OUTCOME MEASURES 
Tt: Introduction 


1.1 In late Spring 1992 a Working Group to determine clinical 
outcomes for inclusion in contracts from April 1993 was set up under 
the NHS Purchasers' Forum. At the same time CRAG, which had 
considered clinical outcomes in 1989 in a Working Group under the 
chairmanship of Professor Bryan Jennett and intermittently since that 
time, returned to the subject and set up a working group to review 
and to take forward work on clinical outcomes. This was to include 
both clinical and public health interests and general as well as 
clinical management. These two initiatives were amalgamated under 
the chairmanship of Mr James Kyle, Chairman, Grampian Health 
Board with support from the CRAG Secretariat and met twice, in 


October and early December 1992. 
eb Remit and Membership 
2.1 The remit, confirmed at the Group's first meeting was: 


to consider and advise Management Executive by December 1992 
on a range of clinical outcomes suitable for inclusion in 
contracts from April 1993; and to advise on ways of achieving 
a better common understanding of the nature and use of clinical 


outcome measures. 


The work is in two distinct phases. This preliminary report 
discharges the first of these and work will continue on Phase 2, 
developing a strategy for reporting outcomes and for a_ better 
common understanding about the whole area of quality of clinical 


care, best use of resources and improving outcomes for patients. 


2.2 The membership of the Group represents general management at 
health board/purchaser and at unit/provider level; public health 
medicine; clinical interests; nursing; general practice and the 
patients' interests; research and clinical audit. The membership is 


set out at Annex 1. 


3.1 


The Context In Which The Group's Initial Recommendations Are Made 


Nature of Outcome Measures 


3.1 The Group concluded that the main purpose of clinical outcome 
measures is not to provide quantified and absolute scores but to set 
the context for discussion between clinicians and management in 
provider units and between providers and purchasers on clinical 
outcomes and quality of care. The intention is to identify variations 
in clinical outcomes; to stimulate discussion about their causes; and 
to develop strategies for improvement. Only after thorough 
examination and discussion will value judgements be possible and the 
emphasis now is on generating critical and constructive dialogue. 
Interpretation of data by qualified practitioners is fundamental to the 
process along with detailed examination of the influence of 
co-morbidity and risk factors affecting the quality of outcome that 


can be achieved. The Group proposes further work in this area. 


3.2 The Group has reviewed the range of data relevant to outcomes 
which is readily available to all units. This is at present limited. 
It was decided to keep the exercise simple and to tackle the easiest 
areas first. Medical (as contrasted with surgical) treatment and 
particularly the long-stay specialties and primary care present 
complex problems because of the difficulty of recording appropriate 
end points. The Group intends to continue work on these and to 
encourage others to carry out relevant research and clinical audit. 
Meantime the Group has concentrated on conditions, operations or 
events that are important in terms of the numbers of people affected 
and the level of resources committed to them and which relate to 
different patient groups and specialties. These are in areas that 


people will recognise as measuring and reporting things that are 


relevant and important. They measure genuine health service 
objectives. 
Comparability 


3.3 Recommendations are made about indicators that are available 
for use now; for establishing baseline levels of performance against 


which progress may be audited over the 3-year period of future 


Py 


contracts; and for a _ start to be made on collecting clinical 
management information on a consistent basis throughout the country 
which will enable reporting by units on a fully comparable basis. 
The aim is for continuous, good quality clinical data collection as 
part of normal day-to-day clinical practice which may be examined 
periodically for particular purposes or ad hoc reviews. Purchasers 
will be assured of fully comparable reports from units which will 
allow a better informed decision making process and better contracts 
to be drawn up. Providers will benefit by being required to report 
on a consistent basis and to the same standards by all their 


purchasers. 
Practical Applications 


3.4 The Group's focus has been on the practical application of 
clinical outcomes that managers can use, which are clinically relevant 
and have the full support of the clinicians or staff involved. This 
must be a joint enterprise with the common goal of better care for 
patients. It is an enabling not a threatening exercise which will 
involve a constructive dialogue between professional clinical staff and 
managers, providing the evidence on which discussions’ with 
purchasers may take place. (This subject is dealt with in some 
detail in the CRAG report on The Interface Between Clinical Audit 
and Management - to be published early in 1993.) Necessary 
changes in professional practice or attitudes will be effected by 
education, by peer example and pressure, by a clearer awareness on 
the part of professional clinical staff of their individual personal 
accountability and responsibility for quality of care; and by 


incentives rather than by sanctions. 
Clinical Audit and Quality of Care 


3.5 The Group considered the distinction between indicators of 
clinical outcome and indicators of the quality of clinical care. The 
Group has concentrated meantime mainly on clinical outcomes but 
stresses the importance of the association between clinical outcomes 
and quality of clinical care as part of quality assurance as it is 
developing more widely. Clinical audit, as clinical quality assurance, 


is of particular importance as the means of demonstrating the 


3.3 


interaction between the structure of a service; the resources used 
by it; the processes used in treating patients; and the outcome of 
treatment. It provides comparison between units; identifies areas 
where improvements are needed; defines and tests better ways of 
doing things; and provides the means of demonstrating that 
improvements have been achieved. Clinical audit can identify areas 
where research is needed and provides a means of implementing 
research findings in practice. The contracting process provides the 
mechanism where both audit and improvements in performance can be 
built into normal day-to-day clinical practice. The potential benefits 
for patients and for the better use of available resources are 


considerable. 
Clinical Guidelines 


3.6 Good clinical practice, standards and outcome are a central 
focus of clinical guidelines. These are the subject of a report by a 
Working Group of CRAG which is to be published in January 1993. 
Development of clinical guidelines is a priority area for CRAG, which 
is working with the Scottish Royal Colleges, specialist societies and 
groups of clinicians engaged in clinical audit projects funded by 
CRAG. Several nationally funded projects have recently reported 
with agreed guidelines, or are about to do so. Other projects have 
already developed core data sets and structured reporting and 
these, along with guidelines, will become increasingly available in 
future. The Group recommends that health boards as purchasers 
should now begin to include these in contracts, and to provide 
resources to support their implementation, by requiring units to 
collect core data on a nationally recommended basis and, from 
national guidelines, to develop protocols for their own practice which 
will reflect their own local circumstances, opportunities and 
constraints. This process of implementation is described in 


Annex 2. 

Involvement of the Professions 
3.7 Increasingly the emphasis is on the totality of care to which all 
health care professionals contribute. The Group has consequently 


identified clinical outcomes for specific conditions and individual 


3.4 


patients without distinguishing between the different components of 
care. Work will nevertheless continue to see if the distinctive 
contributions of the different professions can usefully be separated 


out for investigation and reporting. 
Outcome Measures 
Clinical Information 


4.1 The Group considered that the outcome measures to be 
recommended in the first phase of its remit should be based on 
clinical information generally available equally to all units. The 
central data collections e.g. SMR1 records (on which contracts and 
charging are already based) have been reviewed and are the basis of 
the recommendations set out below. The central data collections will 
by their nature always reflect a highly selected range of basic 
information which will need to be supplemented at local level. The 
quality as well as the nature of the clinical data available is relevant 
to the selection of measures that the Group has been able to make; 
it is consequently somewhat arbitrary. Coding of information is 
particularly complex, and consequently not reliable at present, in 
some conditions e.g. stroke. The Group's first recommendation 
therefore is that professional clinical staff should critically review 
the quality and completeness of their clinical records and secure 
agreement about definitions and coding where this is still needed. 
Clinicians will also be encouraged to make fuller use of available 
codes on SMR1 to record, for example, the immediate outcome of a 
single episode of care. ISD will be the lead interest in taking these 
aspects forward in their joint programme of training conferences with 


CRAG and in their other related activities. 


4.2 Where information is already available, as in SMR1, work should 
be set in hand now to systematise reporting on a consistent basis 
among units; to establish systematic information collection where 
that is not yet available on a consistent basis; to build that into 
resource management; and to establish the baseline of current 
performance against which future changes may be assessed. For the 
measures recommended ISD _ will shortly provide health board 


comparisons for the most recent relevant period available. 


3.9 


Nature of Outcome Measures Recommended 


4.3 The Group concluded that measures recommended must be 
reliable, valid, robust and relevant to both provider unit managers, 
purchasers and professional clinical staff. They should be simple to 
understand and to apply. They should relate to important .areas of 
clinical care and should be sensitive to changes in structure 
e.g. staff or equipment and to processes e.g. forms: of clinical 
treatment. The number of cases likely to occur in a single unit 
influences the areas in which measures can be recommended. It is 
intended that the development of appropriate outcome measures 
should be actively encouraged in the context of clinical audit and 


improvements in the quality of care. 


4.4 Indicators should wherever possible be independent of, or 
should be expressed in terms that allow for, complicating factors like 
severity of disease, case mix, co-morbidity, age etc. This will not 
be possible in the first group of indicators but is a later objective 
which the Group will go on to address. If a proxy measure only 
rather than a direct measure is available its validity must be 
properly established to ensure that it truly reflects the topic under 
review. Again further work will be proposed in this area. 
Wherever possible measures should be quantifiable but the Group 
recognises the importance in relation to quality of care of a range of 
indicators that cannot by their nature be quantified. Further work 
will be done on these. They will include patient's perceptions of the 


process of treatment and the outcome of care. 
Record Linkage 


4.5 Several of the measures recommended depend on ISD's system of 
record linkage. This is available only in Scotland and it allows an 
individual patient's separate episodes of in-patient care, 
re-admissions, destination on discharge and ultimately death to be 
linked continuously over time. Death may be followed up whether it 
takes place in hospital, at home or elsewhere in the community. 
Linkage within the SMR data sets and with certain external data sets 
e.g. blood transfusion, reporting may be carried out on a quarterly 


basis, if required. Linkage giving mortality will become available 
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each year about October, when the Registrar General's records for 
the previous calendar year are issued. This linkage facility will 
allow the clinical history to be followed in future in a wide range of 
conditions for which outcome measures will be developed later. 
Reporting will be possible at all levels of aggregation including unit 
and national level. The Group recognises the relevance of the 
period. over which outcomes should be measured and the possible 
limitations of mortality as a measure of outcome in many conditions. 
Mortality does however offer an immediate start to be made and 


refinement of measures will follow. 
i Clinical Outcome Measures for Contracts in April 1993 


The Clinical Outcome Measures and other activity recommended as 


appropriate for inclusion in contracts from April 1993 are: 


5.1 General Recommendation 


All units/trusts should carry out a systematic review of the accuracy 
and completeness of clinical data collection, at a minimum in the 
areas in which outcomes are specified below. (Assistance in this is 


available from the Information and Statistics Division of CSA.) 


The quality of data should be audited regularly thereafter with the 
aim of achieving 90% accuracy and completeness of coding at the end 
of year one. Monitoring should be carried out by the unit/trust 


with sampling by purchasers. 

ISD will provide regular . reports on an agreed basis, with 
baseline data for the measures proposed below being provided by 
ISD, at health board level, in January 1993. 

5.2 Specific Clinical Outcome Measures 

fractured neck of femur 


7 deaths occurring within 30 days of admission as percentage of 


all admissions 
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: percentage discharged home within 2 months of emergency 


admission from home 


acute myocardial infarction 
= deaths occurring within 30 days of admission as a percentage of 


all admissions with acute MI 


cholecystectomy 
. deaths occurring within 30 days of operation as percentage of 


all patients undergoing cholecystectomy 


carcinoma of the colon 
_ deaths occurring within 30 days of operation as percentage of 


all patients undergoing operation for carcinoma of colon 


transurethal resection of the prostate 


- percentage of re-operations within one year 


medical emergency re-admissions 
= percentage of re-admissions as emergencies within 28 days of 


discharge 
5.3 Clinical Audit Databases and Other Related Activity 


All contracts which include the services set out below should include 


the following provisions: 


ENT Services Units/Trusts to collect the _ clinical data 
recommended periodically by the Scottish National Audit 
Subcommittee for Otolaryngology and participate in the audits 
led by that group; 


Intensive Therapy to initiate core data collection which will 
shortly be recommended by CRAG. Units/Trusts should have a 


policy or guidelines for admission and discharge of patients; 


Coronary Care Units to initiate data collection which will shortly 
be recommended by CRAG and have a policy or guidelines for 


admission and discharge of patients; 


3.8 


General Surgery to maintain core data to enable reporting 
through the Scottish Mortality Study sponsored by CRAG; 


Accident and Emergency Medicine to prepare to collect the basic 
core data which will be defined by the Scottish Trauma Audit 
Group. 


-It is assumed that wherever specific regulations are in force 


eg. in pharmacy, laboratory’ services, diagnostic and 
therapeutic radiology etc. these will be fully covered in 
contracts. 
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MEMBERSHIP 


Chairman: 


Members: 


Hospital Clinician 


General Practitioner 


DPH/CAMO 


Nurse 


Purchaser/BGM 


Provider/UGM 


Research/ Public 
Health Medicine 


SOHHD - 
Medical Services 
Management Executive 
Chief Scientist Office 


CRAG Secretariat 


ANNEX 1 


Mr James Kyle 
Chairman, Grampian Health Board 


Mr Douglas Harper 
Consultant Surgeon 
(Member of CRAG) 


Dr Norman Jarvie 
Crieff 
(NMAC Chairman and member of CRAG) 


Dr Dorothy Moir 
Forth Valley Health Board 


Mrs M McGinn 
South Ayrshire Hospitals NHS Trust 


Mr I Croy Smith 
Argyll and Clyde Health Board 


Mr Mike Kelly 

Falkirk and District Royal Infirmary 
(Member of CRAG - Medical Audit 
Subcommittee) 


Professor Elizabeth Russell 
University of Aberdeen 


Dr Bill Dodd 
Mr Bill Moyes 
Dr Boyd Moir 


Mrs Eileen Barnwell 
Miss Elaine Dobbie 
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ANNEX 2 


CLINICAL AUDIT, STANDARDS AND OUTCOMES IN PRACTICE 


1. The aim is to secure the best possible outcome for the greatest 


number of people for the least possible outlay; 


2. The mechanism is good quality health care that is effective and 


efficient and the best available value for money; 


aC The context is that of continuing, critical evaluation of performance 


and the search for improvements; 


4, The responsibility rests with all professional clinical staff as part of 
a personal accountability for the quality of their own professional 


practice; 


5. Quality and standards of care and outcomes are identified by 
research and the best practice of acknowledged experts is established and 


promoted through clinical audit; 


6. Standards and outcomes are expressed in guidelines for good 
practice which may be drawn up by expert groups drawn from e.g. the 
Royal Colleges, specialist societies, by CRAG sponsored conferences, 
working groups and nationally funded projects and by selected other 


expert groups; 


7. Protocols for good practice are developed at unit or area level. 
These are derived from guidelines for good practice but reflect specific 


local circumstances; 


8. Clinical Audit is used to monitor and evaluate local practice, 
systematically and regularly, against the standards and outcomes 
contained in local protocols. Results are compared against the standards 


adopted locally and against performance by peers working elsewhere. 


3.11 


9. CRAG is the Scottish clearing house for guidelines and clinical 
outcomes, and for core data sets. CRAG will promote their implementation 
advising about new areas where systematic core data collection has been 


identified and on areas that may be appropriate for specific investigation; 


10. CRAG will promote the development of guidelines through the Royal 


Colleges, educational organisations and other appropriate groups; 


11. Data collection and data management will be the responsibility of 
clinicians at unit/trust level as part of the clinical information component 


of resource management; 


12. Basic core data should enable area or national comparisons to be 


made; 


13. Standardised reporting to purchasers on a consistent basis from all 
units or groups will allow consistent comparisons to be made _ between 
units and at national/international level. For provider units standard 
forms of reporting for different purchasers will simplify data collection 


and processing; 


14. CRAG will continue to sponsor the development of core data sets and 
the methodology of clinical audit in different specialties and 
circumstances. CRAG will have continuing responsibility for audit which 
is most appropriately arranged on a national basis e.g. in highly 


specialised areas with restricted numbers of practitioners and patients; 
15. Clinical audit will be carried out at unit/trust and at area level and 
will take different forms reflecting locally agreed priorities which are 


recorded in contracts; 


16. Clinical audit at local level will draw on and progressively absorb 


approaches developed through central initiatives. 
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